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Weak selection, which means a phenotype is slightly advantageous over another, is an important 
limiting case in evolutionary biology. Recently it has been introduced into evolutionary game theory. 
In evolutionary game dynamics, the probability to be imitated or to reproduce depends on the 
performance in a game. The influence of the game on the stochastic dynamics in finite populations 
is governed by the intensity of selection. In many models of both unstructured and structured 
populations, a key assumption allowing analytical calculations is weak selection, which means that 
all individuals perform approximately equally well. In the weak selection limit many different 
microscopic evolutionary models have the same or similar properties. How universal is weak selection 
for those microscopic evolutionary processes? We answer this question by investigating the fixation 
probability and the average fixation time not only up to linear, but also up to higher orders in 
selection intensity. We find universal higher order expansions, which allow a rescaling of the selection 
intensity. With this, we can identify specific models which violate (linear) weak selection results, 
such as the one-third rule of coordination games in finite but large populations. 

PACS numbers: 87.23.-n, 05.40.-a, 02.50.-r 



I. INTRODUCTION 



In evolutionary game theory the outcome of strategic 
situations determines the evolution of different traits in 
a population pQ . Typically, individuals are hardwired to 
a set of strategies. The performance in an evolutionary 
game determines the rate at which strategies spread by 
imitation or natural selection. Due to differences in pay- 
off, different strategies spread with different rates under 
natural selection. In infinitely large well-mixed popula- 
tions this is described by the deterministic replicator dy- 
namics [2H5]. In this set of non-linear differential equa- 
tions the intensity of selection, which determines how 
payoff affects fitness, only changes the time scales, but 
not the direction of selection or the stability properties. 
In finite populations fluctuations cannot be neglected j6j- 
9 . The dynamics becomes stochastic: Selection drives 
the system into the same direction as the correspond- 
ing deterministic process, but sometimes the system can 
also move into another direction. The strength of selec- 
tion determines the interplay between these two forces. 
The absence of selective differences is called neutral selec- 
tion: Moving into one direction is as probable as moving 
into any other, independent of the payoffs. If selection 
acts, the transition probabilities become payoff depen- 
dent and thus asymmetric. The asymmetry can be the 
same in each state (constant selection) or state depen- 
dent (frequency dependent selection). In general, un- 
der frequency dependent selection the probability that 



one strategy replaces another can be fairly complicated. 
However, under the assumption of weak selection, some 
important insights can be obtained analytically [9TU6|. 
It has to be pointed out that these results do in general 
not carry over to stronger selection. 

Weak selection describes situations in which the effects 
of payoff differences are small, such that the evolution- 
ary dynamics are mainly driven by random fluctuations. 
This approach has a long standing history in population 
genetics [T71 [TS]. In evolutionary biology, a phenotype 
is often found to be slightly advantageous over another 
phenotype [HI [20]. Further, a recent experiment suggests 
that some aspects of weak selection are reflected in hu- 
man strategy updating in behavioral games |21) . In the 
context of evolutionary game dynamics, however, weak 
selection has only recently been introduced by Nowak et 
al. [5]. The definition of weak selection is unambiguous 
in the case of constant selection, but there are different 
ways to introduce such a limit under frequency depen- 
dent selection 22 . 

In the simplest case, frequency dependence can be in- 
troduced by an evolutionary game between two types A 
and B. In a one shot interaction (where strategies are 
played simultaneously) a type A interacting with another 
type A receives payoff a, two interacting B types get d 
each. Type A interacting with B gets b, whereas B ob- 
tains c. This symmetric 2x2 game can be described by 
the payoff matrix 
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Let i denote the number of A individuals in a population 
of constant size N. Under the assumption of a well-mixed 



population, excluding self-interactions, the average pay- 
offs for individuals of either type are given by 
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These expectation values are the basis for the evolution- 
ary game. In the continuous limit N — > oo, the state of 
the system is characterized by the fraction of A individ- 
uals x = i/N . The dynamics are typically given by the 
replicator dynamics x — x(1 — x)(tta—itb), which has the 
trivial equilibria x = and x = 1. Additionally, there 
can be a third equilibrium between zero and one, given 
by x* = (d — b)/(a — b — c + d). In finite populations, 
the probabilistic description does not allow the existence 
of equilibrium points anymore. Moreover, the invariancc 
of the replicator dynamics under rescaling of the payoff 
matrix jS] is lost in finite population models. Typically, 
the average payoffs are mapped to the transition proba- 
bilities to move from state i to other states, only i = 
and i — N are absorbing states. When only two types 
compete and there is only one reproductive event at a 
time this defines a birth-death process. The transition 
probabilities from i to i + 1, and from i to i — 1 are then 
denoted by T+ and , respectively. They determine 
the probability of the process to be absorbed at a cer- 
tain boundary, usually called fixation probability, as well 
as the average time such an event takes, termed average 
fixation time. 

An important result of evolutionary game dynamics in 
finite populations under weak frequency dependent selec- 
tion is the one-third rule. It relates the fixation proba- 
bility of a single type A individual, <f>x, to the position 
of the internal equilibrium x* in a coordination game, 
i.e. when a > c and d > b. If selection is neutral, we have 
4>i = l/N. If the internal equilibrium is less than one 
third, x* < 1/3, then </>i > l/N. Originally, this weak se- 
lection result has been found for large populations in the 
frequency dependent Moran process j9]. Subsequently, 
the one-third rule has been derived from several related 
birth-death processes [23"k25] . and also for the frequency 
dependent Wright-Fisher process [37J , which is still a 
Markov process, but no longer a birth-death process. In 
a seminal paper, Lessard and Ladret have shown that the 
one-third-rule is valid for any process in the domain of 
Kingman's coalescence |28j . which captures a huge num- 
ber of the stochastic processes typically considered in 
population genetics. Essentially, this class of processes 
describes situations in which the reproductive success is 
not too different between different types. Thus, the gen- 
erality of the one-third-rule under linear weak selection 
is well established. Here we ask a slightly different ques- 
tion: To which order can two birth-death processes be 
considered as identical under weak selection? Some au- 
thors have considered higher weak selection orders for 
specific processes [215H3T] . We investigate two classes of 
birth-death processes, a general pairwise imitation pro- 



cess motivated by social learning and a general Moran 
process based on reproductive fitness. In this light, we 
also discuss cases which violate the one-third rule. 

The manuscript is organized in the following way: In 
Sec. [Tl] we compute the weak selection expansion of the 
fixation probability in a general case of our two classes 
of birth-death processes. In Sec. |III| we perform the 
same calculations for the significantly more complicated 



fixation times. In Sec. IV we discuss our analytical results 
and conclude. Some detailed calculations can be found 
in the Appendix. 



II. PROBABILITIES OF FIXATION 

A birth-death process is characterized by the tran- 
sition probabilities from each state i to its neighboring 
states, T+ and Tf. We assume that this Markov chain 
is irreducible on the interior states and we exclude muta- 
tions or spontaneous switching from one type to another. 
Thus, the process gets eventually absorbed at i = or 
N. For any internal state, the probability to hit i = N 
starting from < i < N, <fii, fulfills the recursion equa- 
tion <Pi = (1 - T,+ - TT)^ + T(-^_i + T+(b l+1 [32H34]. 
This recursion can be solved explicitly, respecting the 
boundary conditions </>o = and <pN — 1. For a single A 
individual in a populations of B, the probability to take 
over the population is [32H34] 
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In any model of neutral selection, the transition prob- 
abilities of the Markov chain fulfill T~ /T+ = 1, and 
hence the respective fixation probability of a single mu- 
tant amounts to l/N. 

In this section we focus on the weak selection approxi- 
mation of Eq. Q . We do this for two different approaches 
to evolutionary game theory: imitation dynamics and se- 
lection dynamics. In the former case, strategy spreading 
is based on pairwise comparison and imitation, in the 
latter it results from selection proportional to fitness and 
random removal. The most prominent examples are the 
Fermi process and the Moran process, respectively. 



A. Pairwise comparison 

In a pairwise comparison process, two individuals are 
chosen randomly to compare their payoffs from the evo- 
lutionary game, Eqs. ^ and ([3]). One switches to the 
others strategy with a given probability, see Fig. [T] If se- 
lection is neutral, this probability is constant. If selection 
acts, the larger the payoff difference, the higher the prob- 
ability that the worse imitates the better. But typically 
there is also a small chance that the better imitates the 
worse. Otherwise, only the strategy of the more success- 
ful individual is adopted. This would lead to a dynamics 
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FIG. 1: (color online) Upper panel: Pairwise comparison pro- 
cesses are characterized by the probability g(An) to imitate 
the strategy of someone else based on the payoff difference 
An. With increasing payoff difference, the imitation proba- 
bility becomes higher, g'(An) > 0. Weak selection implies a 
Taylor expansion at Atv = 0. Thus, it can only be invoked 
for functions that are differentiable in 0. The figure shows 
three examples of imitation probability functions, gi(An) is a 
linear function (selection intensity /3 = 0.5) and g2(An) is the 
Fermi function (/3 = 50). For the imitation function ga(An), 
a meaningful weak selection limit does not exist since ^(Aw) 
is not differentiable in 0. Because gs(An) = for An < 0, 
the associated stochastic process would be stochastic in time, 
but deterministic in direction. All through the manuscript, 
we focus on imitation functions that are differentiable in 0. 
Lower panel: Moran processes are characterized by a payoff 
to fitness mapping f(n). Fitness is a non-decreasing function 
of the payoff, f'{n) > 0. The figure shows three examples for 
payoff to fitness mappings (selection intensity /3 = 1 for all 
three functions). 



that is stochastic in the time spent in each interior state, 
but deterministic in direction |24j . Thus, given that all 
interior states are transient, the fixation probabilities are 
either or 1 and there is no basis to discuss a weak se- 
lection limit. 

Selection is parameterized by the intensity of selec- 



tion (3 > 0. As a first example we consider the Fermi 
process [24] [35] [36] . Let the two randomly selected in- 
dividuals X and Y have payoffs ttx and ny . Then X 
adopts y'a strategy with probability <?Fcrmi(' 7 ry — ftx) = 
1/ (l + Q-P(*Y~Ttx)y Thus, the transition probabilities 
of an evolutionary game with payoffs Eqs. ^ and ([3]) 
are given by 
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The probability to stay in state i is 1 — T~ — T+. The 
Fermi process is closely related to Glauber dynamics [37] . 
If we define individuals' energy as the exponential func- 
tion of payoff, then the Fermi process can be mapped 
onto the Ising model. The Fermi process has the com- 
fortable property that the ratio of transition probabili- 
ties simplifies to T~ /T+ = e _ ^' rjl_,rs ), such that the 
products in Eq. Q can be replaced by sums in the ex- 
ponent. Defining u = (a — b — c + d)/(N — 1) and 
v = (Nb—Nd—a+d)/(N—l), such that ■ka—tt b = ui+v, 
leads to 
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For large N, the sum can be replaced by an integral, 
leading to a closed expression [23] , For weak selection, 
N(3 < 1, Eq. @ can be approximated by 



1 (N — l)((iV + l)u + 3v) 
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This can also be obtained directly from T~ /T^~ m 1 — 
Pip a ~ tts)- The fixation probability under weak selec- 
tion is greater than in the neutral case if the term linear in 
(3 is positive, Nu + u + Sv > 0. In particular, for a coordi- 
nation game in a large population, this implies x* < 1/3. 
Thus, natural selection favors the mutant strategy, if the 
invasion barrier is less than one-third, which is the well 
known one-third rule [HI [2U EH - It holds when the 
fixation probability in a large but finite population can 
be approximated up to linear order in selection intensity. 

Can we make general statements based on an expan- 
sion of 4>\ concerning the probability of switching strate- 
gies, <7(A7r)? In a general framework, the probability that 
X switches to the strategy of Y, given the difference in 
their payoffs, An = nx — ity, is governed by the inten- 
sity of selection. We call g{An) the imitation probability 
function of a general pairwise comparison process. In a 
well mixed population, the transition probabilities read 
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(8) 



The larger the payoff difference, the more likely the worse 
individual switches to the strategy of the better. There- 
fore the imitation function is nondecreasing, g'(An) > 0. 
Additionally, if the payoffs of the two chosen individuals 
are equal, the neutral probability of switching is non- 
zero, g(0) > (otherwise, the process does not allow a 
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meaningful definition of weak selection because it would 
always deterministically follow the direction of selection) . 
The fixation probability for this general pairwise compar- 
ison process can be expanded to the second order (see 
Appendix A 1 ) 
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and 
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G\ is proportional to the increase of the imitation func- 
tion at An = 0, see Fig. [2] Note that for large N, d > 
is equivalent to Nu + 3v > 0, which for large N fur- 
ther simplifies to x* < 1/3. Thus, the one-third rule 
holds for all pairwise comparison processes that fulfill 
g'(0) ^ 0, and g(0) > 0. Moreover, C\ is proportional to 
2g'(0)/g(0), while C 2 is proportional to the square of this 
quantity. Thus, 2g'(0)/g(0) can be absorbed into the se- 
lection intensity by proper rescaling. Therefore, the more 
rapid the increases of the imitation function at An = 0, 
the stronger is the sensitivity of the fixation probability 
to changes in average payoff. For low switching proba- 
bilities in the neutral case, An = 0, we have a fixation 
probability that changes rapidly when the payoff differ- 
ence becomes important, An ^ 0. While most previous 
models have either considered g(0) — (which lies out 
of the scope of our approach, because it does not lead to 
a reasonable definition of weak selection) or g(0) = 0.5 
(which is the default case), some authors have also ex- 
plored imitation functions with other values of g(0). For 
example, Szabo and Hauert have used the imitation func- 
tion g(x) — 1/(1 + e~ x+a ), where a is a constant [35]. In 
this case 2g'(0)/g(0) = 2/(l+exp(— a)), thus, an increase 
in a is equivalent to an increase in the (small) selection 
intensity. 

Now it is straightforward to come up with an imitation 
function that leads to a violation of the one-third rule, 
for example g(An) = 1/(1 + exp{— An 3 }). Obviously, 
g(/3 An) satisfies the conditions g'((3An) > 0, and g(0) ^ 
0. Further, both the first and the second order expansions 
vanish. Therefore, the fixation probability under weak 
selection can only be approximated as 
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(12) 



where C3 can be derived in the same way as C\ and 
C2. In special games, the sign of C3 can also change at 
x* = 1/3, but in general this will not be the case due to 
the complicated dependence of C3 on u and v. In more 
general terms, the 1/3 rule is not sustained whenever the 
linear approximation of g(f3An) vanishes. 
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FIG. 2: Approximation of the fixation probability of a single 
mutant under weak selection. Upper panel: Pairwise compar- 
ison process with the Fermi function 1/(1 + exp[— fiAn]) as 
imitation function. As shown in the main text, up to second 
order the approximation is valid for any imitation function 
g(/3An) after appropriate rescaling of the selection intensity 
p. Lower panel: Moran process with fitness as a linear func- 
tion of the payoff, / = l + /3n. Any other function leads to the 
same first order approximation after rescaling of j3. However, 
the second order depends on choice of the function transform- 
ing payoff to fitness. Exact analytical results are numerical 
evaluations of Eq. Q. (Parameters N = 100, = 1, a = 4, 
b = 1, c = 1, and d — 5 in both panels). 



B. Moran process 

In the frequency dependent Moran process the pay- 
off 7T, given by Eqs. ([2| and |3]), is mapped to fitness 
/, as illustrated in Fig. [l] In each reproductive event, 
one individual is selected for reproduction (producing an 
identical offspring) proportional to fitness. To keep the 
size of the population to the constant value N, a ran- 
domly chosen individual is removed from the population 
subsequently. As in pairwise comparison processes, the 
state i can at most change by one per time step. 

In the simplest case, fitness is a linear function of pay- 
off. With a background fitness of one, the fitnesses of 
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type A and B read /a = 1 + /3tta, and /s = 1 + /?7Tb, 
respectively. The quantity j3 > serves as the intensity 
of selection. Note that /3 is bound such that fitness never 
becomes negative. The probability that the number of A 
individuals increases by one, i — > i + 1, is given by 
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The other possible transition, i 
probability 



1, occurs with 
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When selection is neutral, j3 = 0, we have Tf = i(N — 
i) /N 2 . Up to linear order in (3 the Moran process has the 
same fixation probability as the Fermi process, Eq. (J7]), 
such that in this approximation the one-third rule is ful- 
filled. This is because under first order weak selection, 
Tf /Tf is again a linear function of the payoff difference. 

In general, let fitness be any non-negative function 
of the product of payoff and selection intensity, /(/?7r), 



which fulfills /'(/?7r) > 0. For simplicity, we assume that 
the baseline fitness /(0) is one. The transition probabil- 
ities in a population with types A and B read 
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Note that Tf /Tf = /(^7r B )//(/37r A ). Up to second or- 
der in /3, the fixation probability of a single A mutant in 



a population of B is (see Appendix A 2 ) 



where 
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with u and v as above. Note that the first order term 
depends on payoff differences only, but the second or- 
der term also depends on the payoff values directly. An 
example for such an approximation is shown in Fig. [2] 
The first order term D\ is proportional to the increase 
in fitness at n = 0, /'(0). The first order term Di is 
proportional to Nu + 3v for large N. Hence, the one- 
third rule holds for every Moran model for which /'(0) 
does not vanish under weak selection. Additionally, /'(0) 
can be absorbed into the selection intensity by rescaling: 
Changing this rate is equivalent to changing the inten- 
sity of selection. Note that this is not possible with D2, 
where not only the slope, but also the curvature of the 
fitness function at the origin plays a role. However, when 
the exponential fitness function / = exp(/?7r) is employed 
[55] . the second term of Eq. (19) vanishes. This allows 



to incorporate /'(0) into the selection intensity even for 
the second order term. 

Again, we conclude the section with an example where 
the one-third is violated. Consider the fitness function 



/(/?7r) = l + /3 3 7r 3 , which obviously satisfies /(0) = 1, and 
/'(/3tt) > 0. Both, first and second order correction in 
P vanish, D\ = D 2 = 0. Therefore, the first non-trivial 
approximation of the fixation probability is 
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If D3 changes sign at x* = 1/3, we recover the one-third 
rule. This is only the case for very special games. In 
analogy to the previous section, the general one-third 
rule does not hold anymore. 



III. TIMES OF FIXATION 

In this section we address the conditional fixation time 
rf. In a finite population of iV — i individuals of type 
B and i individuals of type A, measures the ex- 
pected number of imitation or birth-death events until 
the population consist of type A only, under the con- 
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dition that this event occurs. In general, the probabil- 
ity Pi(i) that after exactly t events the process moved 
from any i to N, which is the all A state, obeys the 
master equation P A (t) = (l - - Tf) Pf(t - 1) + 
TrpA^t - 1) + T+P^t - 1). The average fixation 
time rf = Ylt=otPf~{t)/ < t > i IS the stationary first mo- 
ment of this probability distribution, resulting from a 
recursive solution of (pi t a = (l — — Tp) (pi t a + 
Tf<f H _ 1 ( T A_ 1 + 1) + T+ 4> 1+1 {t a +1 + 1). In a similar way 
one can find = ^2%l. tPP(t)/(l — (pi), such that the 
total average lifetime of the Markov process amounts to 
farf + (1 - <j>i)if [321 HJ1 El]. Following the previous 
section we restrict our analysis to the biologically most 
relevant case i = 1, which yields 32, 40 



JV-l k , 
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(21) 



Maruyama and Kimura [12]) Antal and Scheuring [H] 
as well as Taylor et al. 23] have shown that the condi- 
tional fixation time of a single mutant of either type is 
the same, t a — t^^. This remarkable identity holds for 
any evolutionary birth-death process, and is thus valid 
for any 2x2 game and for any selection intensity. How- 
ever, for j > 1 we have t a =/= r 



N—j 



unless P vanishes. 

Since t a and t^_ 1 are identical up to any order in /3, we 
obtain 



(22) 



for any n. This symmetry can help to obtain several 
properties of the expansion of the conditional fixation 
time, Eq. (21 1, without brute force calculations. 
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A. Pairwise comparison 

Let us first consider the fixation time in the special case 
of the Fermi process, Eq. (pH). When the selection inten- 
sity vanishes, = 0, we have t a (0) = 2N(N-1), [13l|33]. 
When selection is weak, N j3 <C 1, the conditional fixa- 
tion time is approximately t a ps T A (Q)+dpT A (j3)\p = Q /?+ 
d%T A (yf3) |j9=o /^ 2 /2- For the Fermi process, the first order 
term is then given by |13] 
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order term of the conditional fixation time for the Fermi 
process yields 



df3 2 



E lU 2 + E 2 uv + E 3 v 2 , (24) 
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where 



E, - (iV 1)N (180- 1227V + 1777V 2 + 597V 3 ), 
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(25) 



E 3 ~^E 2 . 



Now, in contrast to the first order expansion Eq. ( 23 1 , 
both u and v enter. An interesting relation is E 3 = 
E2/N. In the following, we show that this is found for 
any pairwise comparison process and not only in the spe- 
cial case of the Fermi process. 

For general pairwise comparison processes under neu- 
tral selection, the conditional fixation time is t a (0) = 
N(N - l)/g(Q), where g(0) > 0. When selection acts, 
Eq. (J8|, the transition probabilities become dependent 
on the derivative of the imitation function, </(0) > 0. 
We are now interested in the imitation function's influ- 
ence on the first and second order terms in /3. In general, 
the first order term in j3 reads 
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with the multi-index a — (0(1,0:2,013), \a\ = ai+a2 + a 3 , 
see App. |B 1| for details of the calculation. The general 
structure of this term is determined by h a , which is lin- 
ear in u and v, as |a| equals one. Thus, dpT A \p=a = 
F\ u + F 2 v is also of this form, where F± and F2 only de- 
pend on the population size TV. With the same symmetry 
argument as above, based on (4TJ [43] , we can conclude 
that F 2 = 0. This yields 
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(28) 



We can now calculate the payoff independent term F\ for 
any g(A.n) from the special case u = 1 and v = 0, which 
reads 



wher e u stems from it a — = ui + v, compare App. 
II A The first order expansion of t a is only proportional 



to the i dependent term u in this special case. This can 
also be seen from a symmetry argument |41l 143] : Since 
t a = T§_i_, the fixation time does not change under 
a f-> d and 60c. Since u, but not v, is invariant under 
this exchange of strategy names, t a can depend under 
linear weak selection only on u, but not on v. The second 
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1) 



iV 2 



N-6 



18 



(29) 



Here, (3 can be rescaled by g'(0)/g(0) 2 . Changing g'(0) or 
g(0) is equivalent to changing the selection intensity ap- 
propriately. In particular, when u > 0, which is true e.g. 
for coordination games such as the stag-hunt game |44j . 
the conditional time it takes on average for a mutant 



G 



type to take over decreases with the intensity of selec- 
tion. Moreover, for a > c and b > d in combination with 
u < 0, a mutant which is always advantageous over the 
wild type needs longer to reach fixation than a neutral 
mutant. This phenomenon, termed stochastic slowdown 
in [45], occurs in any imitation process, since Eq. (28) 
only depends on u. 

For the second order term in the expansion in /3 we can 
write 



which corresponds to exchanging the names of the strate- 
gies. For the transformed game, we obtain d'ir^_ 1 \p = o — 
Giu 2 + G 2 uv + G 3 v 2 withw = (Nc-Na-d+a)/(N-l). 



Using Eq. (|22j, we obtain G 2 u(v-v) + G 3 (v 2 ~v 2 ) = 0. 
With v + v = -Nu, wc then get G 3 = G 2 /N — the 
symmetry discussed above for a special case holds for any 
imitation function. Eventually, the second order term in 
/? for general imitation probability is given by 



dp 2 



N-l k 



EEE 

\a\=2 k=l 1 = 1 



(30) 



h a is of the form G 1 u 2 + G 2 uv + G 3 v 2 . Thus d 2 T^\p =0 
is also of this form, where the Gi's only depend on N. 
Again, we consider the transformation a «-» d and b «-> c 



OB 



Ti 4 = G x u 2 + G 2 uv 



2 '1 



G 



2 2 

N V ' 



(31) 



The special cases u = 1, v = 0, as well as u = 0, v = 1 
allow to compute G\ and G 2 explicitly. Thus we have 
(see Appendix B 1 1 



Gi = - 



G-2 



(N -2)(N -1)N 
5400 

N 2 (N - l)(2N- 1) /.g"(0) 



(180 - 122A + 177N 2 + 597V 3 ) ^ 



6 Vff(O) 2 
7V 2 (6-7Ar + A^ 3 ) /2(.g'(0)) 2 
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5(0) E 



r 



V 5(0) 3 



N 2 (N - 1) 



g"(0) 
<?(0) 2 ' 



(32) 
(33) 



Obviously, Eq.(31 1 does not allow a rescaling of the inten- 



sity of selection. Instead, the properties of the imitation 
function enter in a more intricate way. An example of 
this approximation is shown in Fig. [3j 

B. Moran process 

To close this section, we consider the Moran process, 
where selection at birth is proportional to fitness and 
selection at death is random. For neutral selection j3 — 0, 
it is well known that 7^(0) = N(N-l) [I3IM1I1I]- When 
selection is weak ^ « 1, the conditional mean fixation 
time is approximately r^ 4 w ^(0) + dpT^ &■ For the 
Moran process with linear fitness function, Ja — 1+/3ttA) 
we have dprf\p = Q = -uN 2 {N 2 - 3N + 2)/36, compare 
[TBI [43] . The first order expansion of r-f 4 again depends 
only on u, but not on v. This can be shown based on 
gHim or explicitly Q3]. 

With general fitness mapping /(/?7r) with transition 
rates (15) and (16), we have 



d_ 



= -f(0)N : 



0=0 



,N 2 -3N + 2 
' 36 1 



(34) 



which allows a rescaling of the intensity of selection when 
r-j 4 is approximated up to linear order. 

With general fitness function f(x), it becomes un- 
wieldy to calculate higher order terms in j3. However, 



the general calculations are similar to that of the general 
pairwise comparison rules. Eq. ( 19 1 reveals that already 



the second order expansion of the fixation probability <pi 
with general fitness mapping is tedious in form. Thus 
the equivalent terms for the fixation time r-p are even 
more complicated and do not lead to further insight in 
this case. Since it would be only an academic exercise 
to calculate them, we do not give them explicitly here. 
It is clear that the weak selection approximation is not 
universal over a large class of processes in second order 
in the fixation times. 



IV. DISCUSSION 

In the past years, weak selection has become an impor- 
tant approximation in evolutionary game theory [9TH5|. 
Weak selection means that the game has only a small 
influence on evolutionary dynamics. In evolutionary bi- 
ology and population genetics, the idea that most muta- 
tions confer small selective differences is widely accepted. 
In social learning models, it refers to a case where imita- 
tion is mostly random, but there is a tendency to imitate 
others that are more successful. Since weak selection is 
the basis of many recent results in evolutionary dynam- 
ics [El HU I46H48] , it is of interest how universal these 
results are. It has been shown that they are remarkably 
robust and the choice of evolutionary dynamics has only 
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Exact analytical result ~ . . 

' Pairwise comparison rule 



£ 0-92 



~ 0.88 



Second order approximation 



First order approximation 



0.000 0.002 0.004 0.006 0.008 0.010 

Selection intensity |! 



Exact analytical result 



Moran process 



First order approximation 



0.002 0.004 0.006 0.008 0.010 

Selection intensity p 



FIG. 3: Weak selection approximation of the conditional fix- 
ation time of a single mutant, the exact result is given by 
Eq. (21 1. Upper panel: The approximations are shown for 



the Fermi process, but they would be identical up to second 
order for any other pairwise comparison process after appro- 
priate rescaling of the selection intensity. Lower panel: For 
any Moran process the first order approximation is indepen- 
dent of the precise function mapping payoff to fitness (here 
it is linear). Any higher order approximation depends on the 
details of the function. Note that the first order approxima- 
tion in the two panels is not identical due to a difference in 
the dependence on population size N (same parameters as in 
Fig.§ 



are identical, thus they lead to the same result. However, 
in general spatial structure has a less pronounced effect 
under weak selection than under strong selection [53"1 151]. 

We have addressed to what extent two evolutionary 
processes can be considered as identical by investigat- 
ing the fixation probability and the fixation time. For 
any given 2x2 payoff matrix, we have considered two 
classes of evolutionary processes: Pairwise comparison 
and Moran processes. An interesting special case is the 
Moran process with exponential fitness mapping, which 
is equivalent to the Fermi process (a special case of the 
pairwise comparison rule) in terms of fixation probabili- 
ties. 

For the fixation probability, the first order term in the 
selection intensity always has the same form, given that it 
does not vanish. In addition, regardless of the choice of 
imitation functions, two pairwise comparison processes 
are always identical up to second order weak selection 
in the fixation probabilities. For Moran processes, an 
equivalent statement does not hold. Recently, a paper 
has shown that in 3 x 3 games under weak selection, the 
Fermi update rule can be quite different from the Moran 
process and the local update rule (an imitation process 
with linear imitation function jlSj): while the Moran pro- 
cess and the local update rule are more similar to each 
other [53] . Our result shows that for weak selection in 
2x2 games, these three processes can be mapped to 
each other by an appropriate rescaling of the intensity of 
selection. 

For the first order approximation of the average fix- 
ation time, there are differences in the dependence on 
the system size, but all processes depend on the game in 
the same way. This follows from a symmetry in fixation 
times [HI |33] ■ For higher orders in the intensity of se- 
lection, a simple rescaling of the selection intensity does 
not exist for the fixation times and a general statement 
on the relation between two processes cannot be made. 

The robustness of weak selection results, i.e. the in- 
variance to changes of the underlying stochastic process, 
found in the linear approximation is remarkable, but fol- 
lows from basic assumptions on evolutionary dynamics. 
Moreover, the universality of weak selection breaks down 
when higher order terms are discussed. 



a small impact in unstructured populations 28, I n 
structured populations, however, the choice of evolution- 
ary dynamics can have a crucial impact on the outcome 
[TTl H71 15UW54) . For example, for a prisoner's dilemma 
on a graph under weak selection, cooperation may be fa- 
vored by a death birth process while it is never favored by 
a birth death process. In a well mixed population, how- 
ever, the transition probabilities for those two processes 
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Appendix A: Third order expansion of the fixation probabilities 



Here, we expand the fixation probability (f>\ for general birth-death processes up to the third order. Let 7, = T i jT^ 
and 



d(3 s 



(Al) 



0=0 



Note that the first index of p S i refers to the order of the derivative and the second index gives the position in state 
space. We expand Eq.Q to the third order under weak selection 74 « 1 +Puj3 + p2i(3 2 /2 + p 3i /3 3 /6. Hence, we have 



k k 
i=i J= i 



k Ik 

j=i \i=i 



2 



Lit, 
k 



k \ / k \ k 

= 1 \j=l J \s=l / 0=1 



6 ' 



L 3 fc 



Then the fixation probability can be written as 



(A2) 



N-l 



k=l 
Qi 



V 1 



P 2 ^ T /? 3 



N-l 



k=l 



1_ Ql 

N N 2 



Ql Q 2 



N 3 2N 2 



fc=l 
Q 

13 



/ 



Qi Q1Q2 Qa 



N 4 N 3 6N 2 



(A3) 



(A4) 



This now serves as a starting point for our particular processes with certain choices of 74 = T i jT^ and particular 
p s i resulting from this. 



1. General pairwise comparison process 



For general switching probabilities in a pairwise comparison process, we have 



Pit = 

P2i = 
P3i = 



2g'(0) 
9(0) 

2g'(0) 

.9(0) 

O 6(g'(0)) 3 - 3#W(0) + ff(O) V"(0) 3 

~ 2 77v\3 ( A7r *) • 

5(0) ci 



Att,, 



Att, 



(A5) 
(A6) 
(A7) 



Inserting these quantities into Eqs.(A2| and (A3 1 leads to 



JV-l k 



Qi 
Q2 



2 6(g'(0)) 3 + 3g(0) g '(0) g "(0) - . 9 (0)V (0) ^ * 



(A8) 
(A9) 



3(0) 3 



k=l i=l 



24(^(0)) : 
5(0) 3 



AT-1 / k 



E E(^ 



(A10) 



fc=l \i=l 



Qi and Q 2 have been calculated in the main text. Note that they only depend on </(0)/.g(0), whereas Q 3 also depends 
on higher order derivatives of the imitation function. Thus, two pairwise comparison processes that are identical in 
first order are also identical in second order. Only in third order, differences start to emerge. 

Let us briefly come back to our example of an imitation function that violates the 1/3-rule, g(x) — (l+exp(— x )) . 
In this case, we have g(0) = 1/2, #'(0) = g"(0) = and g"'(0) = 3/2. Thus, both Q u and Q 2 vanish and the third 
order expansion of the fixation probability is 



1 N -I 



[{N + l)(3N 2 - 2)u 3 + 15(A + l)Nu 2 v + 30(A + l)uv 2 + 30w 3 ] /3 3 



N 60N 



(All) 



2. Moran processes 

For Moran processes with general fitness functions, we havepu = — /'(0)A7r i andp2i = 2(/'(0)) 2 7r j 4A7Tj — /"(0)(7r J 4- 
7rs)A7Ti. Inserting these quantities into Eqs.(A2) and (A3) leads to 



N-l k 



Qi = -/'(o)EE A7r - 

k=l (=1 

N—l k N-l / k \ ■ 

Q 2 = ((/'(0)) 2 - r (o)) EW- + (/'(o)) 2 E E A?r M 

fe=l i=l fc=l \i=l / 



(A12) 



Thu s, the first and the second order expansion of the fixation probability of such processes are given by Eqs.(18) and 
( 19 ), respectively. In particular for /(tt) = 1 + 7r 3 , both pu and pn vanish and p 3i = — 6(7r 3 4 — tt%)- By Eq.( A3 ), this 
yields 



N-i k 

' 4 + iEE«-^)^ 3 +^ 



N N 2 



(A13) 



A- = l i=l 



D, 



where D 3 = 60JV( ^_ 1)2 ( - 3c 2 d(N - 2)(1 + N)(2N - 1) - 3cd 2 {N -2)(N+ l)(3iV - 4) + 6a 2 6(A - 2)(N 2 -2N + 2) + 
a(a 2 + 3b 2 )(N - 2)(3A 2 - 6N + 1) - c 3 (l + N)(3N 2 - 2) + 26 3 (1 + N- 9N 2 + 6N 3 ) - d 3 {N - 2) (29 - 39A + 127V 2 )) . 



Appendix B: Times of fixation 

General expressions for the first and second order expansion of the fixation time for the birth-death process have 
been given in Eq(26l and Eq.(30|. Based on these, we show the results for the general pairwise comparison rule first 



and then discuss the Moran process. 
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1. General pairwise comparison process 



For the first order term of the fixation time, Eq.(26), each h a on the rhs. is proportional to <?'(0)/.g 2 (0). Thus, the 
first order term of the fixation time is of the form Rg 1 (0) / g 2 (0) . In particular, when g(A7r) is the Fermi function, 
g'(0)/g 2 (0) is one. Hence the first order of the fixation time for the Fermi process is R, cf. Eq.(23|. This leads to the 
first order expansion of the fixation time for general pairwise comparison rule, Eq.([29|. 

For the second order, we write Eq. (30) explicitly as 



dp 



JV-l k 



JV-1 k 



JV-l k 



~ T 1 = EE + E E h (0,2,0) + EE h (0,0,2) 



k=l 1=1 



k=l 1=1 



k=l 1=1 



N-l k 



K 2 
N-l k 



K 3 
N-l k 



2 E E v.i.o) +2 E E v,o,d + 2 E E fc (o,i,i) 



(Bl) 



fe=l Z=l 



fc=l 2=1 



fc=l 1=1 



Ki 



K 5 



Kg 



As shown in the main text, the second order term is of the form of G\U 2 + G 2 uv + jf-v 2 . Letting u = 1 and v = 
leads to 



K 3 
K 5 



N 2 (N - 1)(2N - 1) 2(g'(0)) 2 - g(0)g"(0) 
6 5 (0)3 
N 2 (N - 2) (AT - 1)(17 + 63iV + 167V 2 ) 2( 5 '(0)) 2 
2700 5 (0) 3 
JV(-120 + 4iV + 350iV 2 - 657V 3 - 290iV 4 + 1217V 5 ) 2(3' (0)) 2 
1800 g(0) 3 

N 3 (N 2 - 1) 2(g'(0)) 2 
12 g(0) 3 
N 3 (2-3N + N 2 ) 2(3' (0)) 2 

9 gW~ 
N 2 (2 + 25N - 15N 2 - 25N 3 + 137V 4 ) 2(<?' (0)) 2 
180 g(0) 3 



(B2) 



after some tedious calculations using the identity X)fc=i Ez=i = Y2if 1 [^1 • Summing these iV^'s leads to Gi in 



Eq.(|32|). On the other hand, letting u = and u = 1 yields 

2( 5 '(0)) 2 - 3 (0) 5 "(0) 



K x = N(N - 1) 
K 2 



3(0) 3 

7V 2 (/V-l)(iV-2)2( ff , (0)) 2 



K 3 

K 5 
K 6 = 



18 5 (0)3 
N(4N 3 - 15N 2 + 17N - 6) 2(3' (0)) 2 

3(0)3 

iV 2 (^-l)2(g'(0)) 2 
2 <?(0) 3 
N(N -1)(N -2) 2(g'{0)) 2 

2 3W^ 
iY 2 (A^-l)(iV-2)2(3'(0)) 2 
5(0) 3 



(B3) 



Adding these ifj's yields G2/N as in Eq. (33 1. Thus, the quantities in Eq. (31) are finally derived 



2. Moran processes 



For Moran processes, the approach is fully equivalent to pairwise comparison processes. However, the results do 
not only depend on payoff differences u and v, but on the full payoff matrix with entries a, b, c, and d. This makes 
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the calculations a matter of diligence and leads to quite long expressions, but not to additional insights. Thus, we do 
not give details of the derivation here. 
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